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ABSTRACT 

The  method  of  [l]  for  obtaining  an  approximate  lower 
i0Q(l-ar)7o  confidence  limit  on  System  Reliability  is  used,  except, 
instead  of  a  Gamma  probability  distribution,  a  Normal  probability 
distribution  is  used  as  the  underlying  distribution  for  S,  the 

estimator  of  the  negative  natural  logarithm  of  system  reliability. 

I 

An  investigation  is  made  of  the  errors  involved  in  the 

truncations  and  approximations  used  throughout  the  development* 
A  continuity  correction  factor  is  developed,  and  confidence 
limits  on  system  reliability,  resulting  from  computer  simulation, 
are  presented  both  with  and  without  the  inclusion  of  this  con- 
tinuity correction  factor. 
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1.   INTRODUCTION 

An  ad  hoc  procedure  for  obtaining  an  approximate  confidence 
interval  for  system  reliability  has  been  developed,  based  upon 
Bernoulli  test  data  from  unequal  samples  of  the  various  compo- 
nents of  the  system  [l]o   Integral  to  this  procedure  is  an 
assumption  that  the  unbiased  estimator  of  the  negative  natural 
logarithm  of  system  reliability  may  be  approximated  by  the 
Gamma  probability  distribution.   It  was  the  purpose  of  this 
thesis  to  (1)  investigate  the  errors  in  the  above  mentioned 
procedure  (hereafter  called  the  Woods -Box sting  Method)  resulting 
from  truncation  and  approximation;  (2)  develop  a  different  con- 
fidence interval,  using  the  same  ad  hoc  procedure,  but  assuming 
an  underlying  normal  probability  distribution,  vice  Gamma,  on 
the  unbiased  estimator  of  the  negative  natural  logarithm  of 
system  reliability;  and  (3)  compare  the  confidence  limits 
resulting  from  both  procedures  for  various  values  of  the  para- 
meters involved. 

That  the  investigation  which  follows  was  ever  undertaken  is 
primarily  justified  by  the  results  obtained  under  the  Gamma 

fch 

distribution  assumption.  As  will  be  explained  below,  the  <x 
percentile  of  the  simulated  distribution  of  the  lower  confidence 
limit,  call  it  R   .  *,  and  true  system  reliability,  R  ,  should 

S,L^O/>  S 

be  the  same;  hence,  the  absolute  value  of  their  difference  can 
be  used  as  a  measure  of  the  accuracy  of  the  Wood s-Bor sting 
Method.   In  one  case  the  magnitude  of  this  difference  was  .18 


and  the  average  difference  was  .036.  The  above  figures,  coupled 
with  the  realization  by  the  author's  of  the  need  for  error 
analysis,  motivated  the  undertaking  of  this  thesis. 

Although  Any  one  of  several  probability  laws  could  have  been 
chosen  to  supplant  the  Gamma  distribution  used  in  the  Woods- 
Borsting  Method,  this  investigation  is  limited  to  only  one,  the 
normal  distribution.  If  we  write  the  negative  natural  logarithm 
of  system  reliability  as  -In  Rs  and  define  this  quantity,- for 
simplicity  of  notation,  to  be  identically  equal  to  S,  then  it 
will  be  seen  below  that  two  sources  of  error  are  directly  related 
to  S.  The  first  is  an  error  of  truncation  of  an  infinite  series 
expansion  of  In  R  .  The  second  is  an  error  of  approximation  in 

0 

the  expression  for  Var  (S) ,  where  S  is  the  unbiased  estimator 
for  S. 

Error  analysis  is  performed  on  the  former,  but  not  on  the 
latter,  because  it  is  felt  that,  due  to  the  complexity  of  the 
expression  dropped  in  the  approximation,  this  would,  in  itself, 
be  subject  matter  sufficient  for  a  thesis. 

In  the  following  sections,  the  necessary  background  is  first 
presented,  which  includes  an  explanation  of  the  Woods -Bor sting 
Method,  the  investigation  of  the  two  above  mentioned  errors,  the 
formal  introduction  of  the  normal  distribution  assumption,  and 
the  mathematical  development  of  a  new  confidence  interval  based 
on  this  assumption  of  normality. 

In  Section  3,  the  lower  confidence  limit,  taken  from  the 
confidence  interval,  is  seen  to  a  function  of  random  variables, 
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and  hence  has  some  underlying  probability  distribution.  This 
probability  distribution  is  simulated  by  digital  computer,  the 
shape  of  the  distribution,  and  the  reasons  therefor  ,  are 
discussed,  the  results  are  presented  in  tabled  form,  and  com- 
pared to  the  results  of  the  same  simulation  of  the  Wood s-Bor sting 
Method.   It  will  be  seen  that  the  results  are  in  need  of  improve" 
ment,  leading  to  Section  4. 

In  Section  4,  a  continuity  correction  factor  is  developed, 

A 

necessitated  by  the  fact  that  S,  assumed  to  be  a  continuous  random 
variable,  can,  in  reality,  take  on  only  discrete  values.  This 
continuity  correction  factor  is  then  incorporated  in  the  con- 
fidence limit,  the  distribution  of  this  new  random  variable  sim- 
ulated, the  results  tabulated,  and  comparison  made  to  both  the 
results  of  Section  3  and  the  Wood s-B or sting  Method. 

In  the  last  section,  a  summary  comparison  is  made,  in  a  con- 
denft!*1  i  -■  .  •  !»  .('< .,m   ,..;  in  the  text,  of  the  results  of  the  pre- 
ceding two  sections,  the  Woods-Borsting  Method,  and  a  well-known 
method  of  estimating  system  reliability  when  all  component  sample 
sizes  are  the  same,  based  on  the  Poisson  approximation  to  the 
Binomial  distribution.  Conclusions  are  made  as  to  the  accept- 
ability of  the  Normal  assumption  over  the  Gamma,  and  to  the 
extent  to  which  the  addition  of  the  continuity  correction  factor 
increases  the  accuracy. 

Ever  since  automation  and  advancirg  technology  began  to 
increase  the  complexity  of  various  equipments,  particularly 
military  weapons  systems,  the  purchasers,  and  consequently  the 
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producers,  of  these  equipments  have  become  increasingly  more 
aware  of  the  necessity  for  predicting  the  overall  reliability 
of  these  equipments.  Many  problems  in  the  mathematical  theory 
of  reliability  have  been  solved,  but  one  that  has  not  is  that 
of  obtaining  a  confidence  interval  on  system  reliability  when 
the  reliability  of  the  system  is  to  be  computed  as  the  product 
of  the  various  component  reliabilities,  and  the  sizes  of  the 
test  samples  taken  of  the  various  components  are  not  all  equal. 
If  component  sample  sizes  are  all  equal,  there  exists  a  well- 
known  method  of  obtaining  a  confidence  interval  on  system  re- 
liability, based  on  the  Poisson  approximation  to  the  Binomial, 
as  explained  in  [l],  p.  2,  and  [3],  pp.  218-219.  However,  when 
one  considers  that  components  of  complex  systems  are  being  built 
by  different  sub-contractors  in  different  geographical  locations, 
that  these  components  are  not  mass  produced,  rather  only  a  rela- 
tively small  quantity  of  each  are  ever  manufactured,  and  that 
samples  are  drawn  for  reliability  testing  before  the  whole  system 
is  ever  assembled,  then  the  only  conclusion  is  that  sample  sizes 
of  components  will  rarely  be  the  same,  except  by  accident,  not 
design.  Hence,  there  is  a  definite  need  for  a  method  of  obtain- 
ing a  confidence  interval  on  system  reliability,  based  upon 
varying  sample  sizes  of  components.  Using  the  work  done  in  [l] 
as  a  foundation,  this  thesis  is  an  attempt  to  move  toward  the 
solution  of  this  problem. 
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2.   BACKGROUND 

In  this  section  the  Woods -Bor sting  Method  is  explained  and 
the  mathematical  development  shown,  errors  in  the  Woods -Bor sting 
Method  due  to  truncation  and  approximation  are  pointed  out  and 
investigated,  the  assumption  of  an  underlying  normal  probability 
distribution  for  S  is  introduced,,  and  the  lower  100(l-or)%  confi- 
dence interval  (where  a   ■  P[type  I  error])  based  on  the  normal 
assumption  is  developed. 

EXPLANATION  OF  WOODS-BORSTING  METHOD 
In  a  system  with  k  components  connected  in  logical  series, 
the  true  system  reliability,  R_,  may  be  expressed  as 

k 

V  n  p,  (i) 

s  i=i   i 

where  p  is  the  true  reliability  of  the  i   component,  whether 
the  component  be  continuous  operating  or  cycling  type.  Com- 
ponent reliability  may  be  expressed  in  terms  of  unreliability, 


li* 


and  hence 


Define 


p  =  1  -  q  (2) 

i       i 


k 

L-  n  (1  -  q<)  (3) 

S  i=1       i 


k 

S  =   -In  Rg  -  -  Y  U   <L  "  *i>  <4> 

i»l 
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and,  expanding  the  natural  logarithm  in  an  infinite  series 
k 

»  -  -£{<  -  qt>  -  f  (  -  q±>2+  f<  -  qp3-  ••• } 

i=l 

k       »     qJ 

■rrt 

i=l     j=l 


which  may  he  approximated  by  the  first  two  terms  of  the  series, 
called  T  for  ease  of  expression. 

k        *i2    b 

s4rqi+i~siTi  (6> 

i=l  i=l 


It  is  shown  in  Section  2  that  the  error  due  to  truncation  is 
quite  small;    in  fact, 


s^ZTiH 


L  3(1  -  O  (7) 

is " 


»1         i=l  ± 


It  can  be  shown  (see  Appendix  I)    that  an  unbiased  estimator  for 

A 

Tj,   call  it  T.,    is 

a  2 

a                ~                 i  ,  ~v 

T4    -  a     q.   +  b     (8) 


where 


2n  -  3 

(9) 


1         2(n  -1) 


n. 

-J—  (10) 


i       n^l 


L.    s   n  (ID 

1  i 
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n  being  the  number  of  units  of  component  i  that  lived  out  their 
assigned  mission  time  during  a  test,  and  f .  the  number  of  failures 
of  type  i  observed  during  the  test.  Therefore 


k 

saZTi 

i=l 


(12) 


is  an  unbiased  estimator  of  S.  An  approximate  value  for  the 

a* 
variance  of  S  can  be  shown  to  be  (see  Appendix  II) 


k     ^  kTi 

Var(S)  -Vvar(f1)  -V  — 


i=l 


(13) 


isl 


Thus,  we  have  the  first  two  sample  moments  of  the  random  variable 

A 

s. 

A 

Next,  a  two -parameter  Gamma  distribution  is  fitted  to  S  by 

the  method  of  moments.   If  the  density  of  S  is  taken  to  be  in 

the  form 

r-1 


f-(x;r,8)  m* 


x    exp(-x/9)     ,  x  >  0,  r>0,  9>0 

r  (r)  er 


then 


BCs]  -  9r  -  S 


otherwise 


2    C7  Ti 
Var(S)  ■  9  r  -  \  -=- 

i»l 
Solving  these  equations  for  r  and  9 

i=l     '   i»l  i 


KT± 

1  L  »i 
i=i  x 


i»l 
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and  thus  an  estimator  r,  for  r  is  taken  as 
k      o     /  /  k   t  . 

i=l     /     i=i   i 

A  A   . 

Since  S  is  assumed  to  be  Gamma-distributed,  2S/6  is  distributed 

2 

approximately  X  •  Thus 

2r 

r  * 


«   2S  >   2 

1  -  or  =  P  [  r   XX  .  af   2r  J 

-  P  6r  *  S  /x2 

L       /  1-  a.  2r  J 


"ln  RS  *  .2 


1-  a,  2r 
2r  S 


1-  a,  2r 


2  th  2 

Where  X        is  the  or   percentile  point  in  x   distribution. 
1-  a,2r  2r 


If  r  2s  3  and  a   is  small,  the  quantity  2r/x,   «  is 

l-or,2r 

almost  a  constant  with  respect  to  r.   ...consequently, 

the  random  variable  2r/v^ 


l-or,2r 
...  Thus,  from  this  last  equation...  [l] 


will  have  small  variance 


1  -  cr  =  P 


-In  Rs  ^  S  [2r]  /  X 


1-  a,[2r] 


v  exp  (-  fi  mi  j  x;_      ) 


where  [2r]   denotes   the    smallest   integer  greater  than  or  equal 

to  2r.     The  right-hand  side  of   the  probability  statement   is 
therefore  the  lower  confidence  limit  of  the  Woods-Borsting 


Method,    call   it  R 


'L.C. 


s    and 


16 


R         «  exp  (-S[2r]/x2  „      ) 

SL.C  /     1-^2?]^ 


ANALYSIS  OF  THE  ERROR  DUE  TO  TRUNCATION 
In  the  transition  from  (5)  to  (6)  an  infinite  series  was 
truncated  to  its  first  two  terms c  Examine  the  inner  summation 

of  (5) 

»  i  7        "L   i 

l—   "qi+  2   +^   ,  (H) 

j=lJ         2    J-3  j 


-  T  +  RA 
i    2 

where  R  is  the  remainder  of  the  series  after  two  terms  have 

mm 

been  written  out.   If  we  test  the  n   and  (n  +  l)s  terms  of 
this  series  by  the  ratio  test. 


n+1  / 
q    /  n+l 


nq 


{ (15) 


qn  /  n 


we  see  that  this  expression  is  always  less  than  q  ^  1,  which 
implies  the  series  is  convergent.  Then  by  Theorem  24,  p.  328 
of  [2]. 

lam  |  —H  =  a  (16) 

n_^„   n+l      i 


which  implies  that 

R  s  q^YCn+lXl-r),  r  *  q^  (17) 

n   i  /  i 

Since  r  ^  q  ,  let  us  choose  r  ■  q  £  1  so  as  to  make  R_  as  small 
i  i  n 

as  possible 
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n+1    / 
Rn*  qi         /   (tri-lMl-qp  (18) 

and  evaluating  at  n  ■  2 

V  qi3  /  3(1"qi)  (19) 

Since  q  «  1  in  most  cases  of  interest)  choose  q  =  .15  for 
example,  which  is  about  the  largest  value  it  will  ever  take  on, 
and  we  see  that  R  ^  1.4  x  10"'.  Substituting  equation  (19)  into 

V7  _i_  <  T.  +  q  7  3(l-q  )  (20) 

t~.       i      A    i '       i 

J    *• 

and  substituting  (20)  into  (5) 

k  , 

S  *£(Tt  +  q  3/  3(1^))  (21) 

i=l 

which  upon  distributing  the  summation  sign  becomes  equation  (7) . 

For  q  ■  .05,  still  quite  a  large  value  for  q.  to  take  on,  and 

k  -  15 

k 

S  *  YTi   +  6  x  10"5  »  <2la) 

i^l 

so  the  approximation 
k 

s  -  Y,*i  <*> 

i»l 
is  quite  good. 

INVESTIGATION  OF  ERROR  DUE  TO  APPROXIMATION  IN  Var  (3) 

In  Appendix  II  the  Variance  of  the  random  variable  S  is  com- 
puted, and  it  is  seen  that  the  value  used  in  (13)  above  differs 
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from  the  true  variance  by  a  factor 

Upon  embarking  upon  an  investigation  of  the  size  of  this  term 
it  is  quickly  seen  that  it  is  a  task  which,  due  to  the  amount 
of  work  involved,  is  beyond  the  scope  of  this  thesis*  A  few 
general  comments  on  this  term  are  in  order,  however. 

Being  a  function  of  both  the  q  and  n.,  equation  (22)  may, 
for  certain  combinations  of  these  parameters,  actually  be  less 
than  zero  and  reduce  the  variance  of  So   In  order  to  determine 
when  this  occurs,  it  would  be  necessary  to  use  a  digital  com- 
puter to  compute  and  plot  for  each  set  of  n.,  i"l,  •••,  k,  a 
curve  over  the  range  0  £  q  £  1;  and,  similarly,  to  compute  and 
plot  for  each  set  of  q.,  1*1,  •••,  k,  a  curve  over  the  range  of 
interest  of  n. ,  2  ^  n.£  N,  where  N  might  be  150. 

If  the  summand  of  (22)  is  plotted  as  a  function  of  a  single 

q  ,  with  the  n  held  fixed,  the  curve  is  seen  to  be  bell-shaped 

over  the  range  0  £  q  £  1,  but  within  the  realistic  range  that 

q  may  be  expected  to  take  on,  0  ^  q.£  .15,  (22)  is  a  non-de- 
i  1 

creasing  function,  and  strictly  increasing  unless  a  point  of 
inflection  occurs. 

If  the  summand  of  (22)  is  plotted  as  a  function  of  a  single 
n  ,  where  n,  is  of  course  integer -valued,  it  is  seen  to  be  a 
mono tone -deer easing  step -function,  asymptotic  to  the  n  axis. 

As  a  crude  bound,  on  the  size  of  the  error,  consider  the 
summand  of  (22) 
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3<L2 


2(Dl-l)    l  n±  1  iJ 


V       f  3V  2  1 

2^  n±  *  * 


2ni 


(23) 


(24) 


(25) 


^♦^} 


^       2n7     l  n.       J  (26) 

which  implies  that 

i-l       2(1^-1)  ni  i-1 

which  is  obviously  not  a  least  upper  bound,  but  an  example  is 
informative.  Let  n  ■  20  for  all  i,  and  k  ■  15 

i«l   L        x 

which  admittedly  is  of  an  undesirable  magnitude  for  an  omitted 
term,  but  (22)  is  undoubtedly  much  less  than  .4. 

INTRODUCTION  OF  THE  NORMAL  DISTRIBUTION  FIT  FOR  S 
AND  DEVELOPMENT  OF  THE  ASSOCIATED  CONFIDENCE  INTERVAL 

Now,  instead  of  a  two-parameter  Gamma  distribution  as  was 

used  in  [l],  assume  that  the  distribution  of  S  can  be  fitted  by 

a  Normal  distribution  with  parameters  M-  and  o\     The  prob- 

,  A 

ability  density  function  of  S  is  therefore 
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S 


a  far 

0 


exp  (-  -I  (  *^)     ),       a>  0 


otherwise 


Again  using  the  method  of  moments. 


E[S]   =H=S=-lnR 


Var(S)   -  a       = 


Vr 


i=l 


(29) 


(30) 


Let 


k 


o2 


1  — 
i-1     i 


(31) 


Then 


B[   a  ]  -  E 


k    t 

i-i i 


T. 


k  "1"£ 


i-i 


(32) 


k     T 


i-1 


A  2  2 

and  o   is  an  unbiased  estimator  of  a*  • 

_  A 

Now,  based  upon  the  normality  assumption  on  S, 


1  -  a  =  P  [ 


A 

s-s 


*-*«! 


(33) 


Where  K^  is  the  ordinate  of  the  tabled  standard  normal  distri- 
bution exceeded  with  probability  a   .  Multiplying  by  -1, 
equation  (33)  becomes 


1  -  a  -  P  [^—  £  K  ] 

o  or 


(34) 
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which  may  be  approximated  by 


1-cv-pCs^S+K^a] 


s  p  Cs  *  su<<»  ] 


(34a) 


if  a  is  the  square  root  of  the  unbiased  estimator  of  o   •   Since 


o    was  seen  to  be  unbiased,  let 


/\    /  a  o 

a  =  s/  a  & 


i=i    * 


(35) 


Putting  in  the  values  for  S  and  8  in  (34a) 


1  -  a   =  P 


r7                Tk  T 
.    i=i                Vi«l     x   _ 

k                      /k    Ti 

(36) 


=  P 


R  2:  exp 
s 


V  i-l 


which  is  an  approximate  lower  100(1-  or)%  confidence  interval  on 

R_.  The  associated  lower  confidence  limit,  call  it  Re   .  .  ,  is 
s  , . 5,L(a) 

R 


—  ■  "&' '  \tt\) 


(37) 


Substituting  equations  (8)  through  (11)  in  the  above  express- 
ion, the  result  is 


•ffc*S¥M&*-S 


i=l 


2n-2 


i 
(38 
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which  is  a  random  variable  whose  distribution  is  unknown, 
although  it  is  a  function  of  the  Binomial  random  variables 
f ,,  i  ■  1,  *•*,  k  and  the  parameters  n^  and  k«  Thus,  to 
evaluate  the  worth  of  this  confidence  limit  it  is  necessary 
to  simulate  the  distribution  of  this  random  variable* 
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3.   SIMULATED  DISTRIBUTION  OF  CONFIDENCE  LIMIT  AND  RESULTS 
In  this  section  the  digital  computer  simulation  of  the 

A  A. 

distribution  of  S  +  Kq,  o  is  explained,  as  is  the  method  of 
testing  the  accuracy  of  the  results  of  this  simulation. 
Several  histograms  of  the  computer -simulated  distributions 
are  presented  in  Figures  1  through  4,  with  a  discussion  of 
the  shapes  of  these  histograms.  The  results  of  the  computer 
simulation  are  presented  for  ten  different  combinations  of 
the  input  parameters  in  Table  I  and  these  results  compared 
with  the  same  cases  of  the  Woods-Borsting  Method  in  Table  II. 


SIMULATED  DISTRIBUTION  OF  THE  CONFIDENCE  LIMIT 
AND  MEASURE  OF  ACCURACY 


In  order  to  simulate  the  distribution  of  the  confidence 
limit,  the  input  parameters  k,  n.,  i  ■  1,  •••,  k,  and 

p,  =  1  -  q,,  i  a  1,  •••,  k  are  chosen  and  used  as  inputs 

to  be  computer  program.  The  values  chosen  are  given  in 
Table  I.  Using  true  values,  the  following  are  computed 

in  order  that  they  may  be  compared  with  the  simulated 
values: 
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qi 

T  -  q  + ,  i  -  1,  •••,  k  (39) 


Rs  -  n  p.  (1) 

S   i-1  i 

2 

112 

k 
S  -  ^Ti  (6) 

i=l 


S  -  -In  Rg  (4) 


f,T 


Zn7  (40) 

i-1  i 


Note  that  S  is  computed  two  different  ways  in  order  to  see  the 
effect  of  the  truncation  of  the  logarithmic  series. 

Next,  the  simulated  values  are  generated  by  the  program. 
A  three  digit  random  number  is  obtained  using  a  uniform  random 
number  generator  subroutine.   If  the  random  number  is  greater 
than  p  ,  a  failure  is  "counted"  by  the  computer;  if  the  random 
number  is  less  than  or  equal  to  p^,  no  "count"  is  made.  This 
random  number  generation  is  done  n.  times  for  each  p  .  Thus 
the  number  of  failures  counted  divided  by  the  number  of  units 
of  that  component  becomes  and  estimator  of  unreliability  for 
that  component;  i.e., 
f, 


q  -—  (ID 

i   *i 

The  whole  process  is  repeated  k  times,  giving  an  estimator  for 
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each  q..   Several  arithmetic  operations  are  performed  by  the 
computer  with  these  q.  resulting  in  computation  and  storage  for 
further  use  of  the  following  simulated  values: 


/\ 


"A2 


S\ 


Ti"aiV~  (8) 


k 
S  =  ^T±  (12) 

i=l 


(41) 


In  order  to  complete  the  simulation  of  the  distribution,  it 
was  decided  to  make  500  replications  of  the  above  procedure. 
Thus  500  values  each  of  (12)  and  (41)  are  computed  and  combined 
in  the  form 


k  k  T 


(42) 


for  each  value  of  a.     Three  values,  .05,  .10,  .20,  were  chosen 

for  <x.     The  500  points  of  the  distribution  were  then  sorted, 

by  size,  by  a  separate  subroutine.  The  distribution  was  printed 

out  in  its  entirety  in  order  that  a  frequency  histogram  could  be 

th 
plotted,  and  the  or   percentile  of  this  distribution,  call  it  A, 

was  found  by  the  computer.  Then  e   was  computed  and  printed 

out  for  comparison  with  true  system  reliability,  R  . 

o 
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Consider  the  underlying  meaning  of  the  probability  state- 
ment 


P[  V  RS.L(«)  ]  -  1  -  «  W) 


If  the  probability  density  function  of  Rg  j/a\    is  plotted  on  a 

coordinate  system,  and  R  is  taken  to  be  a  point  on  the  abscissa, 

s 

then  (1  -  a)%   of  the  area  under  the  curve  lies  above  and  &  %   lies 
below  R<,.  Therefore,  Rg  should  be  equal  to  the  or   percentile  of 
the  distribution  of  R      which  we  have  called  exp(-A)  above. 
Thus 


|  Rg-  exp(-A)  |  (44> 


is  a  measure  of  the  accuracy  of  the  procedure  under  investi- 
gation. This  difference  is  shown  in  Table  I  for  all  cases 
simulated. 

DISCUSSION  OF  SHAPE  OF  DISTRIBUTION 
As  will  be  seen  in  Table  I,  ten  different  combinations  of 
the  parameters  k,  n.,  and  p.  were  selected  for  computer  simu- 
lation; for  each  of  these  ten  combinations  three  values  of  or, 
.05,  .10,  and  .20,  were  used,  for  a  total  of  30  different  dis- 
tributions simulated.  Four  of  these  30  were  chosen  as  illus- 
trative of  the  effect  the  parameters  have  on  the  shape  of  the 
distribution,  and  are  included  as  Figures  1  through  4.   In  all 
cases  illustrated  a   ■  .20  and  k  ■  15,  except  Figure  2  where 
k  ■  13.  All  the  figures  utilize  class  intervals  of  width  .025. 
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All  four  are  skewed  right  In  varying  degree,  having  greater 
than  50%  of  the  area  below  the  mean. 

In  Figure  1,  the  n  are  all  equal  as  are  14  of  the  15  p  • 
The  remaining  p^,  p   ■  .85,  is  considerably  lower  than  the 
rest.   In  this  case,  six  of  the  12  class  intervals  in  the 
lower  tertile  have  zero  frequency,   and  these  six  are  not 
adjacent,  rather  are  interspersed  with  class  intervals  of  high 
frequency.  Overall  the  distribution  is  multimodal  and  and  has 
a  range  of  .8868.  The  standard  deviation  is  .136. 

In  Figure  2,  both  the  n.  and  p.  vary  greatly,  5  ^  n.£  150, 
.900  £  p.£  .995.  This  distribution  is  unimodal,  and,  except  for 
an  area  between  the  87tn  and  96   percentiles,  approximates  a 
right-skewed  bell-shaped  curve.  The  range  of  the  distribution 
is  .9545,  from  .108  to  1.0625;  the  standard  deviation  is  .153. 

All  p.  are  equal,  but  the  n.^  vary  greatly,  15  ^  n.£  250, 
in  the  next  case,  shown  in  Figure  3*  The  distribution  is 
unimodal,  and  closely  approximates  a  bell-shaped  curve,  with 
a  slight  degree  of  skewness  to  the  right.  Here  is  the  smallest 
range,  .3696,  and  the  smallest  standard  deviation,  .06,  of  all 
distributions  simulated. 

The  last  case  displayed,  Figure  4,  has  relatively  small 
values  for  the  p.,  .95  for  the  first  14»  and  .85  for  the  15th. 
The  n  are  all  equal  to  20.  This  distribution  is  erratic  over 
its  entire  range,  the  class  intervals  alternating  from  low  to 
high  frequency.  The  range  of  the  distribution  is  1.4063,  but 
it  is  interesting  to  note  that  the  distribution  is  shifted  much 
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further  to  the  right  on  the  S  .   fc  axis  than  the  previous  dis- 
use*) 

tributions,  its  lowest  value  being  .5251.  This  distribution 
also  shows  large  dispersion  about  its  mean,  with  a  standard 
deviation  of  .232. 

From  these  form  illustrative  cases,  coupled  with  an  analysis 
of  the  other  26  cases  which  are  not  graphed,  some  general  con- 
clusions as  to  the  shape  of  the  distribution  can  be  made.  As 
the  p.  decrease  in  value,  the  range  of  the  distribution  increases 

A 

and  the  distribution  shifts  to  the  right  on  the  S  .   v  abscissa. 

U(or) 

If  the  p  are  varied  instead  of  constant,  the  dispersion  of  the 
distribution  about  its  mean  is  larger.  If  the  n  are  varied, 
the  distribution  can  take  on  a  larger  number  of  discrete  values 
within  its  range,  and  the  distribution  becomes  unimodal. 

RESULTS 

The  results  of  the  30  cases,  ten  different  combinations  of 

the  parameters  k,  n  ,  and  p  for  each  of  three  values  of  at,   are 

i       i 

presented  in  Table  I  below.  In  Table  II,  the  results  are  com- 
pared with  the  Wood s-Bor sting  Method. 

Column  (1)  of  Table  I  is  self-explanatory.  The  headings 
of  the  rest  of  the  table  have  been  previously  defined  above, 
but  are  reiterated  here  for  use  in  referring  to  the  table. 
Column  (2)  is  the  number  of  components  in  the  system.  Column 
(3)  is  the  size  of  the  sample  tested  for  each  component  of  the 
system.  Column  (4)  is  the  probability  of  success  for  each 
component  of  the  system.  Column  (5)  is  the  system  reliability 
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TA3LS  I 
RESULTS   OF  COMPUTER  SIMULATION 


(l)k  INPUT   PARAMETERS 

lUJ]     (13     T" 


CASS  k 


ni 


Pi 


(5) 


(6)   ?A   (7)      k   (8)      f      (9)      |    (10) 


•^     '    mean      ; variance 


'    1    ;15 


20 


i.995,  i 

i-l,...,l4    ; 

I    .7924 

.65.1-1.5      H 


.05       .4060       .0249 


,10       .568O   •    .0219        .8264       .0540 


.8761  •  I  .0857 


,20   .5220   .0185  I  .7976   .0052 


2  15 


20 


1.999 
1-998 
j.965 
1.975 
1.967 
1.978 
1 .975 
;  .969 


.962* 

.970'! 
.980!! 
.990,; 
.992!    .6289 

.985:5 
.850. 


.05  :    .7057  1   .0584 


.10  I    .6514       .0548    I    .6552       .0045 


'  i 

.20  ;   .5857  1    .0507      .6600      .0511  I 


150 

i  90 

!  75 

100 

125 

,  18 
28 


191.995 

5  ■  .985 

125 j. 979 

65  :  .988 

125 :  .982 

59  ;  .980 

i.967 


.900: 
.980  l 

.995] 
•970| 

.995;?   .7255 
.9681 


.05       .5052       .0554       .7729       .0496 


,10       .4655       .0296       .7650       .0597 


.20       .4154       .0254       .7524       .0291 


250 
40 

.120 

■:   15 

4     15    150 


\ 


65 
70 
150 


50; 
20 

75 

90  .99, 
100ji*l, 

60' 
60 


.05     .2569     .0068     .8891     .0290  ; 


..,15  i  .3601   .10   .2180   .OO5S   .8780   .0179 


,20   .1951   .0047  J  .8754   .0155  :; 


5   Il5   I 


20 


Ii-l,...,l4   J   .4145 

I 

j.85,   i=15 


.05     1.2195        .0654        .4521        .0176 


.10  a. 1458     .0589     .4514  I  .0169 


.20  I.0525   .0558   .4195   «00^8 
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TAiiLZ  I 
(continued ) 


cass;  I  k 


(1)1 


IKF'JT  ?AR:.:-i-j:,:.a3 

TTK    (5)    i      pry 


JiL 


I    (5)      '.    (6)   :A   (7)      is    (8)      f      (9)      i    (10)      : 
S-i  K,,,£,  |S  ^  K*£lexp(-A)|     ..^  .; 

Rs      '    °^     :    g.ean      'variance ''v<   >J  '  ^' 


6  15 


!  .995, 
20    1=1,... ,14  .7924 

I  .85,  i-15 


.05  i  .5942  • .0255  !  .8761  .  .0857 


.10  '  .5570  {  .0204  I  .6264  I  .0540 


.20  :  .5118  .0172  ;  .800Z  I  .0078 
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250  5c  1 

40  20  I 

12  75 

15  90  |  .99, 

15  150  100  i=l,...,15|f  .8601 

j  65  60  J 

70  60 
150 


.05   .2519  .0035  '  .3955   .0554 


.10   .2125  .0070  ;  .8891   .0290 


.20 


.1389  .OO55  •  .8811   .0210 


j  8   15 


50 


;  .995, 


.05  i    .$556  j  .0072   .8156   .0252 


|i=l,...,l4  .7924    -10j  ,5115  .0066  ;  .3082  j  .0158 


.85,  i=15 


j  .20  \     .2322  ]  .OC58  '  .6068  .  .0144 


20, 

I  i*?  1 ,  * . . ,  h 


.05  j  .4125   .0220  I  .8697   .0775 


j  150,  i=5  .995, 


19  :  15  : 


20, 


i=i,...,i4  .7924   glo j  .5741  :  .0195  [  .8255   .0509 


,;i=6,..,15  .85,  i=15  jj 


;   1 


.20  ;  .5279  : .0162  ;  .7976  .0052 


•20, 


.995, 


.05  ■  .5598  i  .0098  i  .8250    .0526 


|10  j  15  .1^-1, ..,14  i=l,...,l4   .7924  >     .10)  .5165  '  .0084  j  .8200   .0276 


150,  i-15  .35,  1*15 


.20   .2331   .0068  j  .804^   .0120 
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based  on  the  input  parameters  of  columns  (2)  through  (4) . 
Column  (6)  is  the  value  of  a    which  divides  each  case  into 
three  parts.  The  mean  and  variance  of  the  distribution  of 

5  +  Ka  a  are  shown  in  columns  (7)  and  (8) .  Column  (9)  is  the 
exponential  of  the  a       percentile  of  the  distribution,  and 
column  (10)  is  the  difference  between  columns  (9)  and  (5), 
the  measure  of  accuracy  of  the  procedure. 

In  Table  I,  cases  1  and  6  are  identical  except  that  the 
number  of  failures,  f  ,  were  generated  by  the  computer  using 
different  entry  points  to  the  random  number  generator  sub- 
routine. Comparing  the  values  of  |exp(-A)  -Rs|  for  these  two 
cases,  it  is  seen  that  they  are  the  same  for  <y  =   .05  and 
a   ■  .10,  and  differ  only  in  the  third  decimal  place  for  a   ■  .20. 
Therefore,  it  appears  that  500  replications  of  each  case  is 
sufficient  to  overcome  random  fluctuations  in  the  numbers  gen- 
erated, and  it  was  to  investigate  this  area  that  these  two 
cases  were  chosen  identically.   In  reading  Table  I,  one  should 
compare  cases,  1,  6,  9,  and  10,  as  9  and  10  differ  from  1  and 

6  only  in  choice  of  one  of  the  n.;  and  9  and  10  differ  from  each 

other  only  in  the  p  with  which  this  one  different  n.  is  asso- 

I  i 

ciated.  Case  8  is  also  comparable  to  the  above  four  cases,  the 
difference  here  being  that  the  n.  were  increased  from  20  to  50 
for  all  i,  which  appreciably  increases  the  accuracy  of  the  pro- 
cedure. The  results  of  cases  4  and  7  should  also  be  compared 


as  they  differ  only  in  the  choice  of  n  ,  and  again  it  is  seen 
that  the  larj 
being  equal. 


that  the  larger  the  n.,  the  better  the  accuracy,  all  other  things 
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To  see  the  effect  of  the  p  on  the  accuracy  of  the  procedure, 
consider  cases  3,  5,  6.  In  case  3  the  average  p.,  call  it 
p  -  .9702;  for  case  5,  p  «  .9433,  and  in  case  6,  p  ■  .9853. 
At  the  or  =  .05  level,  the  accuracy  improves  as  p  decreases, 
which  is  as  it  should  be.  As  the  p  decrease  the  q.  increase, 
and  thus  when  the  random  number  generator  subroutine  computes 
f  ,  the  number  of  failures,  there  exists  a  greater  number  of 
discrete  values  f .  can  take  on,  hence  a  correspondingly  greater 

number  of  values  S  +  K^  a   can  take  on  in  the  lower  tail  of  the 

fch 

distribution.   It  is  therefore  more  likely  that  the  5   per- 
centile of  the  distribution  will  be  close  to  R  .   In  general, 
the  worst  results  are  for  the  distributions  in  which  a  -   .05  due 
to  the  sparsity  of  different  discrete  values  the  distribution 
can  take  on. 

In  general,  the  results  were  not  too  satisfactory.  In 
only  five  of  the  30  cases  was  exp(-A)  within  .01  of  the  true 

system  reliability,  R  .  Of  considerable  importance  is  the  fact 

s 

that  in  every  case  the  difference  exp(-A)-Rc  was  positive  indi- 

0 
0.1. 

eating  that  the  values  of  A,  the  or   percentile  of  the  distri- 
bution, were  too  small.  This  led  to  the  addition  of  a  continuity 
correction  factor,  developed  in  Section  4,  to  compensate  for  the 
fact  that  S,  in  reality  a  discrete  random  variable,  was  fitted 
by  a  continuous  probability  distribution. 

Table  II  compares  the  above  results  with  the  results  of  the 
Woods -Bors ting  Method.  Columns  (1>,  (2),  (3),  (5)  and  (7)  were 
used  in  Table  I,  and  are  identical  in  definition  here.  Column 
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TABLE  II 


COI'PARISON  OF  V/00DS-30RSTING  METHOD  AND  30KFJTER   SIMULATION 


(1) 

CASE 

■    (2) 

1  (4)  j 
Rat* 

(5) 
expv,  -A ) 

■     (6>     | 

Rs.*-Rs 

(7) 
exp(-A)-Rs 

1 

1 

.79 

I  -05 

1  -10 

1   .20 

:  .69 
!  .71 

:  .77 

.88 
.85 

.80 

.10 

.08 
.02 

.09 
.04 
.01 

2 

.65 

I  .05 

I   .10 

;  ,20 

|  .56 
;  .61 

:  .65 

•65 
.65 
.66 

.07 

.02 
.00 

.02 

.00 

.03 

5 

.72 

!  .05 

!    .10 

!    .20 

;  .71 
.  .69 
.   .71     ! 

.77 
.76 
.75 

.01 

.05 

.01 

.05 
.04 

.05 

' 

.86 

;  .05 

i   .10 
1    .20 

|  .87 

\  .87 
1  .87 

.89 
.88 
.87 

.01 
.01 

.01 

.05 

.02 

.01 

5 

.41 

:  .05 

5  .10 

•:   .20 

*  .53 

.40 

1   .42 

.45 

.45 
.42 

.05 

.01 
.01 

.02 
.02 
.01 

6 

.79 

|  -°5 

i   .10 

;    .20 

:  .69 

i  .71 

!  .77 

.88 

.85 

,80 

.10 
.08 
.02 

.09 
.04 

.01 

7 

.as 

.05 

I   .10 
1   .20 

|  .80 

;  .86 

'  .87 

.89 
.89 

.88 

.06 
.00 
.01 

.05 
.05 

.02 

8      | 

.79 

|  .05 

i  .10 

;   .20 

|  .77 

!   .79     ! 

.82 
.81 

.81 

.02 
.01 
.00 

.05 

.02 
.02 

'  ■ 

.79 

1  .05 
;  .10 

:   .20 

.69 

i  .74 

1  .77    ■ 

.87 

.82 
.80 

.10 

.05 

.02 

.08 

.05 

.10 

|  .05 
10        .79    \  .10 

}  s   .20 


\     .82 

I   .82 
i  .80    \ 


.85 
.82 
.80 


.05 
.05 

.01 


.04 
.05 

.01 
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(4)  is  the  of*  percentile  of  the  distribution  R  of  [l],  and 

s 

column  (6)  is  a  measure  of  the  accuracy  of  the  Woods -Bor sting 
Method.  Table  II  does  not  include  all  the  cases  simulated  in 
[ 1] ,  rather  only  those  which  are  identical  to  the  cases  of 
Table  I*  As  mentioned  in  the  Introduction,  the  average  error 
in  the  Woods -Bor sting  Method  was  .036  for  all  cases  simulated. 
The  average  of  column  (6)  is  .032  while  the  average  of  column 
(7)  of  Table  II  is  .03,  so  at  least  based  on  these  average 
error  figures  the  fitting  of  a  Normal  distribution  rather  than 
a  Gamma,  to  S  appears  to  be  slightly  better,  but  not  signifi- 
cantly. 

The  cases  of  principal  interest  are  those  where  component 
sample  sizes  differ,  since  this  is  the  problem  the  procedure 
was  designed  to  cope  with.  These  are  cases  3,  4,  7,  9,  and 
10.  The  average  error  for  these  cases  under  the  normal  dis- 
tribution assumption  (column  (7))  is  also  .03,  so  it  appears 
to  be  no  better  or  no  worse  for  varying  sample  sizes  than  for 
constant  sample  sizes,  based  upon  the  few  cases  presented  in 
Table  II. 
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4.   SIMULATED  DISTRIBUTION  OF  CONFIDENCE  LIMIT  WITH  CONTINUITY 
CORRECTION  FACTOR,  AND  RESULTS 

This  section  is  devoted  to  a  heuristic  development  of  the 
continuity  correction  factor  mentioned  above,  a  presentation 
in  Table  III  of  the  results  of  the  same  ten  cases  with  the 
correction  factor  included,  and  a  comparison  of  these  results 
with  the  results  of  the  Woods-Borsting  Method. 

DEVELOPMENT  OF  CONTINUITY  CORRECTION  FACTOR 

Since  S  is  a  random  variable  able  only  to  take  on  discrete 
values,  but  was  assumed,  in  (29),  to  be  a  normal  random  variable, 
a  continuity  correction  was  deemed  necessary.  Consider  (8) ,  in 
which  (9)  through  (11)  have  been  substituted 


2n.    -  3 

ni         2(n.-l) 

h* 

T        = 

i       2(nt-l) 

v 

(2n.   -  3) 

f,   +  f.2 
i         l 

2nx   (n. 

:"x> 

(45) 


For  every  possible  number  of  failures,  0  £  f  £  n  ,  T .  assumes 
a  different  value,  and  if  these  values  were  plotted  on  the 
real  line,  the  size  of  the  interval  between  adjacent  values 

A 

would  vary  due  to  the  nature  of  T..   It  was  felt  that,  just 

as  in  the  Normal  approximation  to  the  Binomial  (where  the 

continuity  correction  factor  is  — —  ,  if  n  is  the  sample  size), 

2n 

the  continuity  correction  factor  should  be  related  to  the  size 
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of  the  interval.     Toward  this   end  define 

2 
(2^-3)        (f  +1)  n.  (fj+1) 

T   '  -  — ^-    +  -*—     '  -^7-  (46) 

1         2(nrl)  ni  2(^-1)  nf 


ft     +  (2^-1)    f±  +  2(nrl> 


2^(^-1) 

Then  the  size  of  the  interval  between  the  two  adjacent  values 

is 

T .  '  -  T .  (47) 

i     l 

and  if  the  size  of  this  interval  is  normalized  by  dividing  by 
the  sample  size,  n.,  and  arbitrarily  take  %  the  result,  then 


2    ni    i    1 

x         x       {f ^+(2^-1) f .+2(^-1)}  -  {(2n.-3)fi+fi2} 

2    *  2n.(n.-l) 

i  i 


2ni  +  2fi  "  2  (48) 


4n.2  (n.-l) 


n,  +  f .  -  1 
2n.2  (n^l) 
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is  the  continuity  correction  factor  added.  Notice  that  when 
f  »  0,  which  it  will  a  large  majority  of  the  time  because 
q  «  1,  the  continuity  correction  factor  reduces  to 


2n." 

1 


(49) 


Define 


T  *  -  T  + 

1     i      2n 


(50) 


then  it  follows  that 


S*  =  £  T.* 


(51) 


i=l 


a  *  ■ 


k   T  * 

Ik 

i"! 


(52) 


which  may  be  combined  in  a  probability  statement  similar  to 
(34a) 

1  -  a   -  P  [S  s  s*  +  Ka  a*]  (52a) 


-  p  £s  *  s*(a)  3 


and  the  new  lower  100(1  -  or)%  confidence  interval,  comparable 
to  (36) ,  is, 


1  -  a   »  P 


V  exp(  -pi*  "  **  J  F* 


1  L 


—    n 
1-1  i 


(53) 
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and  associated  lower  confidence  limit  is 


k 


k  ^  * 


L*     -  exp/  -  Ytj*  -  K  /  y-j- 

S,L(o)         \  ^Vi.!  * 

\  i»l  "*■ 


R*  (54) 


the  distribution  of  which  is  simulated  as  before  for  exactly 
the  same  ten  cases,  and  the  results  are  given  in  Table  III* 

DISCUSSION  OF  SHAPE  OP  DISTRIBUTION 
WITH  CONTINUITY  CORRECTION  ADDED 

Figures  5  through  8  below  are  identical  to  figures  1 
through  4,  except  that  the  simulated  distributions  plotted 
have  the  continuity  correction  factor  added.  There  are  no 
significant  differences  apparent;  all  four  of  the  distributions 
with  the  correction  factor  added  have  essentially  the  same  shape 
as  their  respective  predecessors.  All  of  the  general  comments 
made  with  respect  to  the  first  four  figures  also  apply  to  these 
four,  and  they  are  presented  for  comparison  purposes  only. 

RESULTS  OF  ADDING  THE  CONTINUITY 
CORRECTION  FACTOR 

The  results  of  the  same  30  cases,  but  with  the  continuity  corr- 
ection factor  added,  are  presented  in  Table  III  below.  The 
results  are  compared  with  the  Wood s-Bor sting  Method  in  Table  IV, 
and  with  the  results  before  the  continuity  correction  factor 
was  added  in  Table  I. 

Table  III  is  almost  identical  to  Table  I,  the  only  diff- 
erences being  in  columns  (7)  and  (8),  which  are  the  mean  and 
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TABLE  III 
RESULTS   OF  COMPUTER  SIMULATION  WITH  CONTINUITY  CORRECTION  FACTOR 


(l)t         :  INPUT   PARAMETERS 

1JT-     U)     I      F*T 


CASE 


(5)  ?  (6)  *,  (7)  f.  (3),  i     (9)     i   (10) 
Rq   I  c^   .  ffioan   1  variance       Jrtp^/^jl 


1  115  | 


20 


.995 
i«l,....,l4 


.05   .4269  S  .02^0   .3476   .0552 

t 

:' 

,7924   .10   .5876   .0205   .6045   .0119 

, , 1 

.20   .5598   .0175    .7791  .  .0155 


1^999  T9o2" 

^.993  .970 

j  .965  .980 

:  .975  .990 

j  .967  .992 

:!  .973  .935 

1 .975  .350 
.969 


2  :  15  ■ 


20 


.05   .7516   .0594    .6753  j  .0449  I 


.6289  •  .10  ;  .6761    .0558   .6519  1  .0250 


.20   .6OS9  ;  .0517  I  .6415   .0126 


;i5o  19 

90  5 

75  125 

100  65 

3  [13  -125  125 

18  59 

28 


\  .995 

S985 
•  .979 
-  .988 
f  .982 


.900:: 
.980 II 

.995 
.970;: 

.995^ 


.05   .5622   .0527  ,;  .7248  j  .0015 


.930  .968 
.967 


.7255   :     .10    ;     .5155    \     .0279    \    .7218   :     .0015 


I 
.20  j  .4589  ;  .0226  ^  .7158  ;  .0075 


250  JO 

40  20 

'120  75 

15  90 

4  15  ,150  100 


65 

70 

150 


60 
60 


j  .99, 

;  i=>  1  ,  .  .  .  ,  1 5  : ■  '■ 


.05   .2457  i  .0066   .3815  I  »02l4 


.8601  [     .10  j  .2240  :  .0057  I  .8765  ;  .0162 


;2o  I    .2002  I    .0047  ;    .3702  I    .0101 


.05  1 1.2386  j    .0678  \   .4459      .0514 


5  15  ; 


20 


\ i~l t . . . , 1^ : 


I  .85,1=15 


4145  \    .10  i  I.1625  ;  .0650  j  .4429  •  .0084 


120  :  1.0702  j  .0573  i  .4102  I     .0043 
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TABLE  III 
(continued) 


(1):  INPUT  ?;-.h:. ."" 


iOASE     k 


-El 


T5)     f  (6) 


;.    (7).    ;     (8)     :     (9)     *   (10) 


ciean      :  variance 


6  -:  15 


.995, 


20 


ii-l,...,l4  ^924 
I  .85,  Is  15  I 


.05  :  .4326  1  .0255  I  .8^76   .0552 


.10  j  .5929  ;  .0225  '   .804}   .0119 


.20  j  .5^9   .0192   .7817   .0107 


250   50 


40 

20  : 

12 

75 

15 

90 

.99, 

7   15  130 

100  ' 

i-l,...,15  .6601 

65 

60  1 

70 

60  j 

150 

,05   .2598  :  .0091  ;  .8786   .OI85 


.10   .2574  '  .0076   .3755   .0152 


.20  !  .2101  !  .0061  '  .8710   .0109 


8  !  15 


.995, 
j  i-l,...,l4   .7924 


}  .85,1-15 


.05   .J444   .0076   .8125   .0199 


.10   .5199   .0069   .8064   .0140  ■ 


.20  ■  .2902  ;  .0062   .8040   .0116 


20, 

i«l, . . .,4 


9   15 


150,  i-5  .995, 

i-l,...,l4   ,7924 
20, 
i--6,..,15  .55,  i-15 


.05   .4265  I  .0259   .8571   .0447 


.10   .5875   .0211   .8028   .0104 


.20 


,5401  j  .0180  I  .7828   .0096 


.05   .5654   .C091  .  .8017  j  .0095 


;  20, 


.90^ 


y;> 


10  £  15 1  i-l,..,l4  i^i,...,i4  .7924   .10   .5577   .0079  j  .8006   .0032 


;  150,  i-15  .85,  i-15 


.20  £  .5065  )   .0065  :  .7916  ;  .0008  : 
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variance  of  the  new  simulated  distributions  with  continuity 

correction  included,  and  in  columns  (9)  and  (10)  where  A*  has 

th 
been  used  to  denote  the  or   percentile  of  the  distribution  with 

correction  factor  included.  Cases  1  and  6,  which  are  identical 

except  for  the  entry  point  into  the  random  number  generator,  are, 

as  in  Table  I,  identical  in  column  (10)  for  a   ■  .05  and  .10,  and 

differ  only  in  the  third  decimal  place  for  or  =  .20.  Cases  1,  6, 

8,9,  and  10  are  very  similar  and  should  be  compared  to  each 

other  in  reading  the  Table.  Cases  4  and  7  are  also  comparable 

to  each  other.  Cases  3,  5,  6  show  the  affect  of  the  p  on  the 

i 

accuracy  of  the  procedure. 

The  overall  picture  presented  by  Table  III  is  much  more 
encouraging  than  that  of  Table  I.   In  nine  of  the  30  cases  the 
measure  of  accuracy  (column  (8))  was  less  than  .01  and  in  two 
more  was  less  than  .0105,  and  considering  the  number  of  signi- 
ficant figures  in  the  input  parameters,  the  results  are  prob- 
ably not  significant  to  four  decimal  places,  so  these  two  could 
be  taken  as  equal  to  .01,  giving  11  cases  less  than  or  equal  to 
.01.  The  average  difference  in  magnitude  between  e    and  R 

0 

was  .017.  For  cases  3,  4,  7,  9,  10,  the  ones  in  which  com- 
ponent sample  sizes  vary,  the  average  difference  was  .012,  a 
slight  improvement. 

Table  IV  compares  the  results  with  the  continuity  correction 
factor  to  the  results  of  the  Woods-Borsting  Method.  This  Table 

is  identical  with  Table  II  with  the  exception  of  columns  (5)  and 

th 
(7),  where  A*  has  been  used,  vice  A,  to  denote  the  <x       percentile 
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TABLE  IV 


COMPARISON  0?  WOODS-BQRSTING  METHOD  AND  COMPUTER 
SIMULATION  WITH  CONTINUITY  CORRECTION  ADDED 


(1)      ?   (2)   fU)   r   (^7 


TTT 


J6J 


CASE   I    Rg      i    <* 

■ 


Rg,v:    exp(-A*)  RSt^-Rs 


.05 
.79  )    .10 
.20  I 


.69 
.71 


.85 
.80 

•78 


.10 
.08 
.02 


.05  | 
.65  ;  .10  ■ 

.20    I 


-56 
.61 
l65 


.67 

.65 
.64 


.0? 
.02 

.00 


.op 
.72  I    .10  • 
.20 


.71    J 
.69 
.71  I 


.72 
.72 


.01 

.05 

.01 


.86 


.05  ; 
.10  ! 
.20   ■ 


.37 
.37 
.87 


.88 
.88 


.01 
.01 
.01 


I    .05 
.41  I    .10 

;     .20 


•58 
.40   j 

.42   ; 


•«5 

.42 
.41 


.05 
.01 
.01 


.05  .    .69  .85 
6         .79  ::    .10  \    .71  !  .60 
L :     .20  .;    .77  ;  .76 


.10 
.08 
.02 


.00 

.01 


.86 


.05 
•10 
.20 


.80 

.86  | 
.67 


•88 

.88 
.37 


.02 
.02 

.01 


8 


|    .05 

•79  |    .10 

.20 


•77  | 

.78 
•79 


.81 

.80 
.80 


.02 
.01 
.00 


.02 
.01 
.01 


I    .05  I 
9     I    .79  ;    .10 
!     .20  ! 


.69 
.74 

-ill 


T8T 
.80 
.73 


.10 

.05 

.02 


.05 

.01 
.01 


I    .05 
10        .79      .10 
i  i    .20  i 


.82  [ 
.82  :: 
.80  * 


.80 
.80 
.79 


.05 
.05 

.01 


.01 
.01 
.00 
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of  the  new  distribution  with  correction  factor  added.  As  in 
Table  II,  the  entries  in  the  body  of  the  Table  have  been  rounded 
to  two  significant  figures  due  to  the  nature  of  the  input  para- 
meters. The  average  error  in  column  (7)  with  the  continuity 
correction  factor  added  is  .017,  and  is  significantly  less  than 
the  average  error  of  column  (6),  .036,  for  the  Woods-Borsting 
Method.  However,  it  is  noteworthy  that  this  high  average  is 
attributable  to  three  large  values.  Taking  away  the  three 
largest  values  from  both  column  (6)  and  (7) ,  the  column  averages 
become  .023  and  .021,  respectively,  which  are  insignificantly 
different. 

In  Table  V  the  results  obtained  before  the  continuity 
correction  factor  was  added  are  compared  to  the  results  obtained 
upon  introducing  the  correction  factor.  The  body  of  the  table 
gives  the  number  of  cases  for  which  the  magnitude  of  the  measure 
of  accuracy  was  within  the  range  specified  in  column  (1).  The 
sizes  of  intervals  in  columns  (1)  were  so  chosen  because  of  the 
fact  that  |R  -  exp(-A) |  is  only  accurate  to  two  places,  even 
though  computed  to  four  places.  For  example,  the  four-place 
value  .0142,  when  rounded  off  becomes  .01,  hence  the  choice  of 
the  second  interval  of  .0051  to  .0150.  The  addition  of  the 
continuity  correction  factor  made  a  marked  improvement  in  the 
results  as  can  be  seen  both  in  the  average  value  of  the  accuracy 
measure,  .028  before,  compared  to  .017  after,  and  in  the  in- 
creased number  of  cases  that  fall  in  the  intervals  representing 
the  best  accuracy.  Before  the  continuity  correction  was  added 
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TABLE  V 

COMPARISON  OF  COMPUTER  SIMULATIONS  WITH  AND 
WITHOUT  CONTINUITY  CORRECTION  FACTOR 


(1) 

(2) 

(3) 

|Rs-exp(-A) 1 

without 

with 

CC 

CC 

.0000  —  .0050 

2 

4 

.0051  --  .0150 

6 

15 

.0151  —  .0250 

7 

6 

.0251  —  .0350 

10 

1 

.0351  ~  .0450 

1 

2 

.0451  --  .0550 

1 

0 

.0551  —  .0650 

0 

2 

.0651  —  .0750 

0 

0 

.0751  —  .0850 

3 

0 

>  .0850 

0 

0 



TOTAL 

1 

30 

30 

Average  Accuracy 

|Rs-exp(-A) | 

j 

.028 

.017 
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only  one-half  the  cases  were  within  .025  of  true  system 
reliability,  while  after  the  addition  of  this  correction,  25 
of  the  30  cases  had  accuracy  better  than  .025*  Additionally, 
prior  to  the  use  of  the  correction  factor,  there  were  three 
cases  in  which  the  accuracy  was  no  better  than  .075,  whereas 
upon  adding  the  correction  factor,  there  were  no  cases  worse 
than  .06.  Based  on  these  30  cases  it  is  amply  apparent  that 
the  continuity  correction  factor  improves  the  procedure 
considerably,  and  considering  the  fact  that  (52a)  is  an  appro- 
ximate confidence  interval,  this  procedure  appears  usable  in 
situations  where  rough  lower  bounds  on  system  reliability  are 
permissible. 


# 
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5.   CONCLUSIONS  AND  ACKNOWLEDGEMENTS 

In  this  section  the  results  of  [l]  and  the  results  of  this 
thesis  are  compiled  together  in  Table  VI,  comparisons  are  made 
and  results  discussed.   Secondly,  general  conclusions  based  on 
the  entire  thesis  and  recommendations  for  further  investigation 
are  made. 

TABULATION  OF  OVERALL  RESULTS 

In  Table  VI  are  presented  the  results  of  computer  simu- 
lations of  four  different  approaches  to  the  problem  of  obtaining 
a  lower  100(1  -  a} %   confidence  interval  on  system  reliability. 
Two  of  the  four  are  from  [ l] ,  the  well-known  Poisson  approxi- 
mation and  the  Woods -Bor sting  Method.  The  remaining  two  are 
the  ones  developed  in  this  thesis,  fitting  a  normal  distribution 
to  S,  both  with  and  without  a  continuity  correction  factor. 

Column  (4),  Ya>    is  the  a       percentile  of  the  simulated  dis- 
tribution of  a  confidence  limit  involving  a  Chi-square  random 
variable  and  based  on  the  Poisson  approximation  to  the  Binomial. 
Inherent  in  this  procedure  the  fact  that  sample  sizes  of  all 
components  must  be  equal,  hence  no  entries  can  be  made  for  cases 
3,  4,  7,  9,  and  10.  The  rest  of  the  column  headings  have  been 
explained  above,  either  in  connection  with  Table  II  or  Table  IV. 
If  all  four  methods  were  perfectly  accurate,  all  the  entries  in 
columns  (4)  through  (7)  would  exactly  equal  column  (2) . 

Notice  how  poor  the  Poisson  approximation  is  in  Case  5,  a 
case  where  the  p.  are  relatively  small  (see  Table  I),  and  in 
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TABLE  VI 

COMPARISON  OF  COMPUTER  SIMULATIONS  WITH  AND  WITHOUT  CONTINUITY 

CORRECTION  FACTOR,    POISSCN  APPROXIMATION, 

AND  WOOD- BORS TING  METHOD 


(1)  i  (2)  i  (3)  i  (4)  i        f5j 


W 


TTT 


CASS 


i 


R 


Sj. 


exp(-A)  exp(  -A*  ) 


.79 


.05 

.10 
.20 


!  .76 

?  .75 

i    »72 


i  «c5    i  -54 


.69 
.71 


.68 


.63    j  .10 

.20 


;  .54    * 

■7? 


•56 
.61 
^61 


.65 
.63 


.85 
.80 
-7ft 


.67 

.65 


3         .72 


i  .05 
i  .10 
I  .20 


.71 

.69 

21 


.77 
.76 

-05- 


.72 
.72 
J JSL 


4         .86 


§  .05 

I  .10 

.20 


.37 
.37 


.89 
.88 


5      1  .41 


I  .05 

I  .10 


.20 


I  .09 
*  .11 

\   .15     ' 


.38 

.40 
.42 


.43 
.43 

JiZ. 


.45 
.42 

-JLL 


f  * 


:  .05 

79  ;  .10 

t  .20 


;   .76 

I   .73 

'   .72 


.69 
.71 


.88 
.83 


.85 
.80 


]     7      1  .86 


I  .05 
;  .10 
I  .20 


.86 
.86 


.39 
.89 


.88 
.88 


1.8         .79 


\  .05 
I  .10 

!  .20 


1  -I6    I 

1  .76 

-.77    ; 


.77 
.78 
.79 


.82 
.81 


.81 

.81 


9     1 .79 


i  .05 
1 .10 

!  .20 


.69 
.74 
^12. 


.37 

.82 


.84 
.80 


I  10      .79 


!  .05 
■  .10 
i  .20 


—    i 


.82 
.82 
.80 


.83 

.82 
.80 


.80 
.80 
-09- 
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case  2.  The  procedures  recorded  in  columns  (5)  through  (7) 
also  have  places  where  accuracy  is  bad,  but  these  occur  for 
the  most  part  in  cases  where  oe   ■  .05,  which  is  to  be  expected, 
for  the  reasons  mentioned  in  Section  3.  From  Table  VI  one  can 
see  that  these  three  procedures  display  much  more  consistency 
in  their  accuracy  than  does  the  Poisson  approximation  method. 
The  average  error  of  the  Poisson  approximation  is  .049,  and 
reiterating,  the  average  errors  for  columns  (5)  through  (7) 
are  .036,  .028,  and  .017  respectively. 

SUMMARY 
In  the  preceding  three  sections,  an  approximate  lower 
100(1  -  <?)%  confidence  interval  on  system  reliability  has  been 
developed,  based  on  the  procedure  of  [l],  but  differing  from 
[l]  in  that  the  probability  distribution  fitted  to  S  by  the 
method  of  moments  is  normal  rather  than  Gamma.  The  lower  con- 
fidence limit  of  this  confidence  interval  is  a  random  variable, 
and  in  order  to  test  the  accuracy  of  the  approximate  confidence 

interval,  the  distribution  of  this  confidence  limit  was  simu- 

th 
lated  by  digital  computer,  and  its  oe       percentile  compared  to 

true  system  reliability.  Figures  1  through  4  are  histograms  of 
four  representative  distributions;  the  reasons  for  their  shapes 
are  discussed.  The  level  of  accuracy  obtained  was  not  satis- 
factory, and  hence  a  continuity  correction  factor  was  developed 
and  added  to  the  lower  confidence  limit.  The  distribution  was 
again  simulated  by  computer,  the  histograms  of  the  same  four 
distributions  were  plotted,  and  the  or   percentiles  of  all  30 
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cases  were  compared  to  true  system  reliability  as  a  measure  of 
accuracy  of  the  procedure..  The  changes  in  shape  of  the  four 
distributions  plotted  were  negligible. 

In  conclusion,  it  appears  that  the  method  developed  above 

A 

by  fitting  a  normal  distribution  to  S  without  continuity  corr- 
ection factor  is  no  better  or  no  worse  than  the  method  developed 
in  [l]  by  fitting  a  Gamma  distribution  to  S.  Both  have  several 
large  errors  in  accuracy ,  and  both  have  average  accuracy  error 
on  the  order  of  .03.  After  the  continuity  correction  factor  is 
added  the  method  of  this  thesis  is  certainly  better  than  the 
same  method  before  the  continuity  correction  factor  was  added, 
as  can  be  seen  from  Table  V9  and  appears  to  be  better,  on  the 
basis  of  average  accuracy ,  than  the  method  of  [1].  However, 
in  examination  of  Table  IV,  cases  4  and  8  have  better  accuracy 
by  the  Woods ~Bor sting  Method,  so  one  must  conclude  that  neither 
of  the  methods  is  universally  better  than  the  other.  It  is  not 
realistic  to  compare  the  method  of  [l]  to  the  method  developed 
above  with  continuity  correction  factor,  because  no  correction 
factor  has  been  added  to  the  former D  a  point  mentioned  by,  and 
currently  under  investigation  by  the  authors  of  [1].  Another 
conclusion  that  <^ae  as  a  by-product  of  this  investigation  is 
that  one  should  use  the  Poisson  approximation  with  great  skep- 
ticism as  the  results  are  evidently  not  at  all  consistent  in 
their  accuracy. 

It  appears  that  further  investigation  of  this  entire 
procedure  is  called  for,  and  some  recommendations  as  to  the 


paths  this  investigation  should  take  are  mentioned  below. 
First,  no  variation  in  k,  the  number  of  components  of  the 
system,  was  made,  and  this  is  certainly  a  cogent  area  for 
exploration  to  see  what  effects  this  parameter  has  on  the 
accuracy.  Secondly,  it  would  seem  desirable  to  simulate  a 
great  many  cases,  with  different  combinations  of  the  parameters 
k,  p  ,  n  ,  with  an  eye  toward  devising  a  set  of  rules  by  which 
one  could  decide  in  advance  which  method  would  give  the  best 
results,  dependent  upon  the  parameters  involved.   It  is  im- 
possible to  make  any  statements  of  this  kind  with  only  ten 
different  combinations  of  parameters  to  examine.  A  third  area 
for  further  investigation  is  one  already  mentioned  in  Section  2, 
that  of  investigating  the  error  involved  in  truncation  of  the 
expression  for  the  variance  of  S. 

I  would  like  to  thank  Dr.  W.  Max  Woods  of  the  Operations 
Analysis  Department  of  the  U.  S.  Naval  Postgraduate  School  for 
suggesting  this  problem  to  me,  for  allowing  me  to  use  the  pro- 
cedure of  [1]  as  a  starting  point,  and  for  the  helpful  sug- 
gestions given  me  throughout  the  course  of  this  investigation. 
I  would  like  to  also  acknowledge  the  help  of  Dr.  Rex  H.  Shudde, 
also  of  the  Operations  Analysis  Department,  for  allowing  me  to 
use  the  computer  program  he  developed  for  the  procedure  of  [l], 
to  which  only  minor  modifications  were  necessary,  and  for  the 
assistance  in  programming  he  gave  me. 
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APPENDIX  I 


DERIVATION  OF  T  ,  THE  UNBIASED  ESTIMATOR  OF  T 

i  i 


In  order  that  T  be  an  unbiased  estimator  of  T. ,  it  is 
necessary  that 


T.  -  eCTj] 


Rewriting  the  above  expression,  using  (6)  and  (8) 


q  .  ♦  — 

1    2 


Vi    ,  bi£i 


n-       2 


and,  substituting  (11) 
.  2 


,i+_     -E 


"«ifi    \h2 


n 


1  2ni2 


«1 


i        * 


2n.2 

i 


E  Cf^] 


ainlqi       bi        ,      2     2  2  J  x 
+  _±_  (n  2q/  -  n.q.*  +  n  q  ) 

n.  91X  x   x 


1  2n, 


ai<li  + 


Mi' 


V  '  57  >  +  biqi 


b         «  2 


(a     +  )    qt  +  (bt   -  —  ) 

1       2n 


i.    qi 


*i        2 
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Chen  equating  coefficients  of  q     and 

*i.2 
2 

a.  +  ■  1 

1       2nt 

b. 
b     -  -i    •  1 
i       nt 

and  solving  simultaneously 

bi     . 

a     +  s  1 

i       2n. 

i 

r(bi}-r<nT 

)  -  K> 

\  +  T^2 

Substituting  back 


.  -  i-  (3-b.) 


b. 

JL(3-b.)  +  -i-  -  1 

2     i    2^ 

b. 

i 


3  -  b  +  nT 


and  again  substituting 


n. 
i 

i   n±.l 


n 

(  -*— » 

n  -1 
i 
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Thus, 

2n.-3         „     ^  2 

£      x  ni    Hi 


is  an  unbiased  estimator  of  T. . 
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APPENDIX  II 


COMPUTATION  OF  VARIANCE  OF  § 


k 
Var(S)   =  Var/  YTiJ  >  Var  (T  ) 


U-l  /         iffil 


Var(T  )=  e[t\2  1   -  E2  C^] 


e[t.    ]  -  v 


bA2  ? 

E[Ti2]   =E[(ai5.+-T-)2] 


b  2^.4 

ELa^2  *  a^3  +    —  1 


a  2  a  b  b  2 

I  x  i 


From  [4] 


B[f       ]   -  n.   q  ^  -  n  q  **  +  n  q. 
i  i     i  i  i  l  i 


E[£  3  ]   =  E[(f  .-E[f  J)3]  +  3E[f.]E[f  2]    -  2E  [f  ] 

=  n  3q  3  -   3n.2q.3  +  2n  q  3  +  Sn^q^  -   3*^*+  n  qt 
i     i  i     *•  x  1 
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E[f  *  ]   -  E[(f   -E[f  ])4]  +  4E[f,]E[f  3]    -  6E2[f.]  E[f  2]  + 
i  i  i  i  i  11 


SE4^] 


n.4q  4  -  6n.3q  3  +  lln  2q  4  -  18n  2q  3  +  7n  2q  2 
i  i      i  i       i  i       i  i      i  ni 


4         3        2 
6niqi  +  I2niqi  -  711^  +  n±q± 


Therefore 

(2n.-3)2 

B[f  i2]   "     2     "       2     2     ^2qi2  '  Vi2  +  Vi  } 
2  (n  -1)   n  Z 
i  i 


3niqi2  +  niqi    } 

r      4     4       ,34       ^33  ,,24 

J    n     q        -  6n  Jq       +  611  Jq       +  lln.    q.      - 

L     t     i  ii  ii  11 


2(ni-l)2n.3 


n 
+ 


4(n  -l)2n  4 
1  i 


18n  2q  3  +  7n  2q  2   -   6na  4 

i      i  i     i  ii 


+  I2n  q  3  -  7n  q  2  +  n  q     j 

1  i  11  i  l  ■> 
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E[T   2]   = 

X 


(4n.2-12n.+9)    (Vl!  -  qt2  +  ^M <\ \'"*ti 


X  X 


4(^-1)  V 


+  2q 


3  +  3n,q,2    •   3q.   +  q^ 


•i^i 


4(11.-1)^ 


(n^q.4  -6n.2q.4  +  6^+  Un.q.*-   ISn.q,^  7n,g,* 


4(n  °*1)   n 
i  i 


6q4  +  I2q.3   -   7q.2  +  q.) 


4(n  -1)   n 
i  i 


n  3(q.4+  4q.3  +  4,>  n.2   (-6,.*-^/-  V  +  **i> 


i       i  i 


4n  (n  -1) 
i     i 


4       .3-2 


+     n.(Uq.     +  SqJ-2q     -8q  ) 

xi  x  *• 


4n  (n  -1) 

x     x 


+  2q/  +  4q. 


4n.(n,- 
i     x 


Let 


A  =  q+4q3  +  4q2 


4  3  2 

B  ■  -6q  H  -    I2q        -  4q       +  4q 
i  i  i 


C  «=   llq  4  +  8q  3   -   2q.2   -   8q 


4 

i 


i  "* 


D  »  -6q  4  +  2q  2  +  4q, 
i  i 


Then  3  ? 

An       +  Bn  *  +  Cn     +  D 

EC*  2]   -  -~ — 

1  4n  3  -  8n  2  +  4n. 

i  i  * 


B  +  ^       (C  +  2B  +  3A)ni  +  (D  -  B  -2A) 


*  4ni  4n  (n     -1) 


2 


i     i 


2     -qi4-qi3+  q^  qi      ^i4-^3*^2)*! 

,  *  + +  -— 


-(2q.4  -  4qt3  +  2qi2) 
4ni(ni-l)2 

T2  +  !i_+     «i'  .  qi2  -  (qi3+qi\     qi2(qi-1)2 
i         ni  2n.        2n£  nj,  Stn^n  -1) 
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ECT  2]  -  T  2  -  Var( 


Ti    qi2  fi  ,    ^r1)2 

i    ni   ni   j^2      i    i    2(^-1) 


which,  when  simplified,  gives 

.  ,4,   Ti  ^i^V^i^i2^2^-^ 

Var (T1>   =  nT        —  j  ~ ~~ " 

i  i(  2(ni-l) 


-1  +  --1—  Jl  +  -±-     -  2q2   -2q. 
Oi       2(n.-l)     )  ni  ii 


which  we  approximate  by 

T. 
Var(T)    -     -^- 
i  n. 

i 

k       T 

*    •    r~^     i 

Var(S)    -    £    ~n~ 

i=l       * 

and  the  truncation  error  is 

k  a  2    r  V 

^      I  2(n  -1)  ^  X 

i=l     \        i  l_ 
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correction  factor  is  developed,  and  confidence  limits  on  system  relia- 
bility, resulting  from  computer  simulation,  are  presented  both  with  and 
without  the  inclusion  of  this  continuity  correction  factor. 
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